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B-248882 
August  18, 1994 

The  Honorable  William  V.  Roth,  Jr. 

United  States  Senate 

Dear  Senator  Roth: 

You  asked  us  to  examine  the  Navy’s  plans  for  acquiring  tactical  aircraft 
because  of  concerns  that  they  were  dupUcative  and  unaffordable.  Since 
your  request,  some  naval  aviation  programs  were  terminated  and 
duplication  and  costs  have  been  reduced.  Your  staff  subsequently  asked  us 
to  determine  whether  the  Department  of  Defense’s  (dod)  acquisition 
regulations  permitted  classification  of  the  F/A-18E/F  program  as  a  mqjor 
modification  rather  than  a  new  program  to  avoid  the  more  rigorous 
review,  analysis,  and  documentation  required  to  justify  a  new  program. 


Results  in  Brief 


In  pursuing  these  issues,  we  found  that  the  Under  Secretary  of  Defense  for 
Acquisition,  on  May  12, 1992,  jq)proved  the  Navy’s  October  1991  request 
that  the  F/A-18E/F  development  be  designated  as  a  mqjor  modification  of 
its  existing  F/A-18C/D,  instead  of  a  new  program.  He  decided  that 
acquisition  regulations  did  not  require  a  Cost  and  Operational 
Effectiveness  Analysis  (coea)  for  this  modification,  and  he  waived  certain 
live  fire  testing  requirements.  'The  Under  Secretary  based  his  decisions  on 
(1)  Navy  analyses  that  indicated  the  EVF  development  was  a  low  to 
moderate  risk  and  (2)  recommendations  made  by  the  Conventional 
Systems  Committee  of  the  Defense  Acquisition  Board  (dab). 

.^plicable  defense  acquisition  regulations  allow  management  discretion  in 
these  matters  for  the  purpose  of  minimizing  development  time  and 
reducing  costs.  By  treating  this  as  a  modification,  some  steps  normally 
followed  for  new  acquisitions  have  been  skipped.  We  are  not  in  a  position 
to  conclude  whether  the  decisions  made  thus  far  will  have  a  positive  or 
negative  effect  on  the  program. 


New  Program  or 
Mgyor  Modification 


The  decision  to  develop  the  F/A-18E/F  was  based  on  the  Navy’s 
determination  that  it  needed  an  upgraded  carrier-based,  multi-role  fighter 
that  could  perform  both  air-to-air  and  air-to-ground  missions.  The  Navy 
concluded  that  this  need  could  most  aq)propriately  be  met  by  follow-on 
development  of  its  only  existing  multi-role  aircraft,  the  F/A-18C/D. 
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The  Navy  considered  the  F/A-18E/F  development  a  modification  because, 
in  its  estimation,  the  aircraft  would  be  a  logical  continuation  of  an  upgrade 
strategy  begun  in  1982  for  the  Navy’s  F/A-18  multi-role  strike  fighter.  In 
defending  its  decision,  the  Navy  stated  that  90  percent  of  E/F  avionics 
would  be  common  to  those  of  the  C/D;  the  engine  would  be  derived  fi-om 
the  C/D;  and  the  Ei/F  would  essentially  be  a  larger,  more  capable  version  of 
the  C/D. 

The  Navy  stressed  the  commonality  of  the  two  aircraft,  but  there  are 
significant  differences  between  the  two.  The  E/F  wUl  weigh  about 
25  percent  more  and  will  have  a  25i)ercent  larger  wing,  a  35-percent  larger 
horizontal  tail,  a  15-percent  larger  vertical  tail,  and  a  34-inch  fuselage 
extension.  Weapon  stations  will  increase  firom  9  to  11,  and  there  will  be 
new  engine  inlets.  TTie  differences  are  such  that  an  existing  F/A-18C/D 
cannot  be  modified  to  the  E/F  configuration,  and  the  EVF  will  require  a 
separate  production  line.  Some  senior  dod  officials  on  the  Conventional 
Systems  Conunittee  of  the  F/A-18E/F  dab,  after  noting  the  differences 
between  the  F/A-18E/F  and  the  F/A-18C/D,  expressed  the  opinion  that  the 
F/A-18E/F  was  a  new  start  However,  these  officials  did  not  make  an  issue 
of  this  factor  and  the  consensus  of  the  Board  was  that  the  F/A-lSEl/F  was  a 
modification.  Tlie  dab  Chairman  and  ultimate  decisionmaker,  after  hearing 
the  arguments  presented  during  the  dab,  made  the  decision  to  approve  the 
program  as  a  msgor  modification. 

The  Navy  proposed  developing  the  F/A-18E/F  as  a  m£Uor  modification  to 
its  F/A-18  in  1991.  The  Under  Secretary  of  Defense  for  Acquisition,  the 
F/A-18E/F  milestone  decision  authority,  in  his  May  12, 1992,  Acquisition 
Decision  Memorandum,  approved  the  Navy’s  request  and  authorized  entry 
of  the  E/F  into  Engineering  and  Manufacturing  Development  (emd), 
subject  to  the  submission  of  a  fiilly  funded  F/A-18EI/F  program.  Approval 
included 

•  a  waiver  of  full  live-fire  testing; 

•  a  waiver  of  the  coEA  requirement; 

•  a  provision  restricting  the  issuance  of  Navy  letter  contracts  for  emd  unless 
the  Navy’s  A-X  (later  designated  the  A/FX)  coea,  evaluating  both  the 
F/A-18£yF  and  the  F/A-18C/D  as  alternatives,  supported  the  Under 
Secretary’s  decision;  and 

•  a  requirement  to  conduct  a  dab  milestone  IDA  review  before  approval  of 
low  rate  initial  production. 
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DOD  Instruction  6000.2  states  that  if  a  mgjor  modification  program  is 
approved,  the  milestone  decision  authority  will  determine  which 
acquisition  phase  should  be  entered.  This  decision  will  be  based  on  the 
level  of  risk,  the  adequacy  of  risk  management  planning,  and  the  amount 
of  resources  to  be  committed. 

In  granting  the  live-fire  testing  waiver,  the  Under  Secretary  acknowledged 
that  the  Navy  was  developing  a  F/A-18E/F  live  fire-test  plan  that  would  be 
less  rigorous  than  normally  required.  The  Deputy  Director,  Test  and 
Evaluation,  live-Rre  Testing  disagreed  with  the  waiver,  stating  that 
extrapolating  data  firom  previous  tests  of  the  F/A-18  and  applying  it  to  the 
EyP,  as  the  Navy  plans,  is  risky.  The  waiver  is  allowed  under 
10U.S.C.2366. 

In  June  1992,  the  dod  Inspector  General  criticized  the  Navy  for  not 
preparing  a  coea  to  demoivstrate  that  the  F/A-18E/F  is  the  most 
cost-effective  solution  to  a  recognized  military  need.  The  Office  of  the 
Secretary  of  Defense  countered  that  the  F/A-18E/F  would  be  a  m^jor 
modification  of  an  existing  aircraft  and  that,  according  to  dod  regulations, 
a  COEA.  is  not  necessarily  required.  The  Inspector  General  subsequently 
reported  that  the  Navy’s  A/FX  aircraft  coea,  dated  November  19, 1992, 
comparing  the  F/A-18E/F  to  both  the  F/A-18C/D  and  the  proposed  A/FX 
aircraft,  satisfied  his  earlier  concerns.  This  coea  was  prepared  by  the 
Center  for  Naval  Analysis. 

After  the  Under  Secretary’s  £q>proval,  the  Navy  did  develop  a  F/A-18E/F 
live-fire  test  plan,  and  the  Center  for  Naval  Analysis  performed  a  limited 
F/A-lSEl/F  coea  (dated  December  1992)  using  information  and  analysis 
firom  the  A/FX  coea.  The  Fiscal  Year  1993  National  Defense  Authorization 
Act,  Public  Law  102-484  section  214,  dated  October  23, 1992,  required  the 
Navy  to  develop  prototype  aircraft.  According  to  the  F/A-18E/F  Deputy 
Program  Manager,  the  Navy  will  use  two  emd  aircraft  for  that  purpose. 

Navy  officials  commenting  on  a  draft  of  this  report  cfiss^eed  with  our 
characterization  of  the  F/A-18E/F  coea  as  limited.  They  said  all  coeas  were 
limited  to  some  degree.  ’They  said  a  number  of  fixed-wing  aircraft  were 
considered  including  the  A/FX,  the  F/A-18C/D,  the  F-22,  and  the  A-6E.  We 
commented  on  the  limited  depth  of  the  Navy’s  analysis  in  an  earlier 
examination^  of  the  decision  to  develop  the  F/A-18E/F.  At  that  time,  we 
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reported  that  dod’s  acquisition  regulations  required  the  Navy  to  consider 
alternative  ways  to  perform  missions  before  2q>proving  a  development 
effort,  such  as  Air  Force  bombers  or  missiles.  The  Navy’s  analysis  did  not 
explore  these  alternatives.  In  fact  the  Center  for  Naval  Analysis  officials 
who  prepared  the  coea  agreed  that  the  E/F  coea  was  limited. 


DOD  Instruction  5000.2  (Defense  Acquisition  Management  Policies  and 
Procedures)  states  that  a  mqjor  modification  may  be  brought  about  by  a 
change  in  threat  or  defense  planning  guidance,  an  identified  operational 
deficiency,  or  an  opportunity  to  reduce  ownership  costs.  Neither  dod 
Directive  5000.1  (Defense  Acquisition  Management)  nor  dod  Instruction 
5000.2  provide  specific  criteria  for  determining  whether  an  acquisition 
program  should  be  classified  as  a  modification  or  a  new  start  The 
regulations  do  allow  the  Under  Secretary  of  Defense  for  Acquisition  to 
make  that  determination. 

DOD  Directive  5000.1  (Defense  Acquisition  Management)  and  dod 
Instruction  5000.2  (Defense  Acquisition  Management  Policies  and 
Procedures)  normally  require  new  programs  to  be  analyzed  and  reviewed 
at  various  decision  milestones  and  receive  Department  Eqjproval  before 
proceeding  through  each  successive  step  of  the  acquisition  cycle.  Figure  1 
depicts  dod’s  System  Acquisition  Process. 
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Rgure  1 :  DOD’s  System  Acquisition 
Process 


Identify  deficiencies  in  military  capability  and 
opportunities  to  improve  effectiveness  that  could 
require  a  new  acquisition  program.  This  is  a 
continual  process. 


Milestone  0 

1 

I  ^ 

Phase  0-Concept  Exploration  and  Definition 

Determine  whether  an  identified  mission  need 
warrants  study  ol  alternatives.  If  warranted, 
approval  is  given  for  concept  studies  to  identify 
the  most  promising  solution. 

Conduct  studies  to  define  and  evaluate  feasibility 
ol  alternative  concepts  to  satisfy  mission  need; 
develop  cost,  schedule,  and  performance 
objectives. 

1 

1 

Milestone  I 

Oetermine  whether  a  new  acquisition  program  is 
warranted.  It  approved,  establish  cost,  schedule, 
and  performance  objectives. 


Define  design  characteristics  and  expected 
capabilities  ot  system  concept(s);  demonstrate 
and  evaluate  critical  technologies  and 
processes. 


Determine  whether  continuation  ol  development, 
testing,  and  preparation  for  production  is 
warranted.  If  approved,  proceed  with  completion 
ol  design  and  preparation  for  production  decision. 


Phase  Il-Enginsering  and 
Manufacturing  Oevalopmant 

Develop  stable,  producible,  and  cost-effective 
system  design;  validate  manufacturing  processes, 
test  and  evaluate  system  capabilities. 


Milestone  III 

1 

Phase  Ill-Production  and  Deployment 

Determine  whether  program  warrants  a 
commitment  to  build,  deploy,  and  support  the 
system.  If  approved,  enter  lull-rate  production. 

Establish  a  stable,  efficient  production  and 
support  base:  produce  weapon  and  equip  units; 
conduct  follow  on  testing;  monitor  performance 
and  quality. 

Milestone  IV-Major  Modification 

1 

Phase  IV-Operations  and  Support 

Determine  whether  upgrades  to  a  system 
currently  in  production  are  warranted  and  if 
required  establish  an  approved  acquisition 
strategy  (or  the  program. 

Ensure  the  fielded  system  continues  to  meet 
mission  needs  and  can  be  maintained  and 
supported:  overlaps  Phase  III. 

Note:  When  the  Under  Secretary  approved  the  F/A-18E/F  development  as  a  major  modificaiton, 
he  approved  entry  Into  phase  II  of  the  acquisition  cycle  or  the  engineering  and  manufacturing 
development  phase 
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As  shown  in  figure  1,  milestone  0  requires  a  determination  that  an 
identified  mission  need  warrants  study  of  alternatives.  Approval  is 
obtained  to  conduct  studies  that  define  and  evaluate  the  feasibility  of 
alternative  concepts  to  satisfy  mission  needs  and  to  develop  cost, 
schedule,  and  performance  objectives.  Milestone  I  requires  a 
determination  that  a  new  acquisition  is  warranted.  If  ^proved,  program 
cost,  schedule,  and  performance  objectives  are  established;  design 
characteristics  and  expected  system  concepts  are  explored;  and  critical 
technologies  and  processes  are  evaluated.  Milestone  II  requires  a 
determination  that  continuation  of  development,  testing,  and  preparation 
for  production  is  warranted.  If  ^proved,  the  program  enters  emd,  to 
develop  a  stable,  producible,  and  cost-effective  design;  validate 
manufacturing  processes;  and  test  and  evaluate  system  capabilities. 
Milestone  in  requires  a  determination  that  the  program  warrants  a 
commitment  to  build,  deploy,  and  support  the  system.  If  approved,  the 
program  enters  production.  A  stable,  efficient  production  and  support 
base  is  established;  weapons  and  equipment  are  produced;  follow-on 
testing  is  conducted;  and  performance  and  quality  are  monitored. 

The  cumulative  amount  of  review,  analysis,  and  documentation  for  any 
acquisition  program  increases  as  the  program  progresses  through 
acquisition  decision  milestones.  When  the  Under  Secretary  ^proved  EI/F 
development  as  a  mqjor  modification,  he  ^proved  entry  into  phase  n  of 
the  acquisition  cycle  or  the  emd  phase.  By  doing  this,  he  authorized 
bypassing  acquisition  phases  0  and  I.  If  the  E/F  had  been  treated  as  a  new 
start  with  development  starting  at  milestone  0,  there  would  have  been 
additional  documentation  requirements  and  milestone  reviews.  For 
instance,  milestone  0  approval  would  have  required  a  new  Mission  Needs 
Statement  identifying  a  mission  need  that  cannot  be  met  by  existing 
systems.  The  statement  must  be  supported  by  a  validated  threat 
assessment  The  Navy  did  not  prepare  a  Mission  Needs  Statement  for  the 
EyP.  It  relied  upon  the  assessment  that  justified  the  original  F/A-18  in  the 
mid-1970s.  Milestone  I  approval  would  have  required  either  provisions  for 
competitive  prototyping  or  an  exception  obtained. 

Before  a  system  can  enter  phase  III  and  be  deployed,  certain  additional 
analyses  may  be  required.  The  system  should  include  the  following: 

•  A  System  Threat  Assessment  Report  that  documents  the  military 
department’s  threat  assessment  justifying  the  system. 
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Development 
Contract  Awarded  to 
McDonnell  Douglas 
Aircraft  Company 


•  A  Test  and  Evaluation  Master  Plan  that  lists  the  critical  development  and 
operational  test  objectives  and  outlines  the  testing  and  evaluation 
approach  and  methodology. 

•  A  COEA,  that  compares  the  cost-effectiveness  of  alternatives.  At 
milestone  HI,  Production  Approval,  the  analysis  may  be  only  an  update  of 
a  previous  analysis. 


On  July  20, 1992,  the  Navy  awarded  the  McDonnell  Douglas  Aircraft 
Company  a  soie-source  contract  to  develop  the  F/A-18EVF.  We  determined 
that  the  Navy  complied  with  requirements  of  the  Competition  in 
Contracting  Act  (cica).  cica  generally  requires  agencies  to  use  fiill  and 
open  competition  for  procurements.  However,  it  recognizes  an  exception 
to  this  requirement  when  an  agency  reasonably  determines  that  only  one 
type  of  property  or  service  is  available  to  satisfy  its  needs  from  only  one 
responsible  source.  This  decision  involves  the  determination  that  the 
expected  cost  to  develop  another  source  could  not  be  recovered  through 
competition  or  that  an  unacceptable  delay  in  fulfilling  agency  needs  would 
occur. 

With  regard  to  the  costs  needed  to  develop  another  source  for  the  aircraft, 
the  Navy’s  justification  and  jqiproval  (j&a)  document,  required  by  cica  to 
support  the  sole-source  award,  states  that  McDonnell  has  been  the  sole 
designer,  developer,  weapon  system  integrator,  and  producer  of  the  F/A-18 
for  over  15  years.  As  a  result,  McDonnell  owns  much  of  the  technical  data 
needed  to  develop  any  F/A-18  derivative.  The  j*a  document  stated  that 
McDonnell  has  an  established  supplier  base  and  composite  material  and 
manufacturing  processes  that  are  not  expected  to  change  substantially  for 
the  EVF.  On  this  basis,  the  j&a  document  concluded  that  the  additional  cost 
to  develop  another  source  to  the  level  necessary  to  provide  an  upgrade  of 
the  F/A-18  aircraft  would  be  prohibitive  and  could  not  be  recovered 
through  competition. 

The  Navy’s  j&a  document  also  concluded  that  the  time  needed  to  develop  a 
second  source  would  result  in  an  undue  delay  in  meeting  established 
milestones.  At  the  time  the  determination  was  made,  the  aircraft  the 
F/A-18EyF  was  intended  to  replace  were  ejqjected  to  start  reaching  the  end 
of  their  fatigue  lives  in  the  mid-1990s.  The  j&a  document  states  that  it 
would  be  time-consuming  to  acquire  the  full  F/A-18  technical  disclosure 
package  and  estimates  that  the  time  needed  to  develop  a  second  source 
would  result  in  an  unacceptable  delay  of  at  least  2  years. 
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Our  review  was  conducted  in  accordance  with  generally  accepted 
government  auditing  standards.  We  did  not  obtain  written  agency 
comments,  but  we  did  obtain  oral  comments  on  a  draft  of  this  report  from 
Defense  and  Navy  officials.  Their  views  were  incorporated  where 
appropriate. 

We  are  sending  copies  of  this  report  to  the  Secretaries  of  Defense  and  the 
Navy.  We  will  also  make  copies  available  to  other  interested  parties  upon 
request 

If  you  or  your  staff  have  any  questions  concerning  this  report,  please 
contact  me  at  (202)  512-3504.  M^or  contributors  to  this  report  were 
Jess  T.  Ford,  William  C.  Meredith,  Jerry  W.  Clark,  and  Anthony  J.  DeFrank. 

Sincerely  yours. 


Richard  Davis 

Director,  National  Security 

Analysis 


(TOtOlO) 
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